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Examiner 
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The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply ts specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)D Responsive to communication(s) filed on . 

2a)Q This action is FINAL. 2b)M This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) £3 Claim(s) 1-43 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-43 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) ^ The drawing(s) filed on 13 August 2001 is/are: a® accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

11) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)Q All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.Q Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachment(s) 

1 ) £3 Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) □ Notice of Drattsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) £3 Information Disclosure Statement(s) (PTO-1449) Paper No(s) 5 . 6) □ Other: 
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Claim Objections 

1. Claims 19, 24 and 25 are objected to because of the following informalities: 
Appropriate correction is required. 

Claim 19 states "The method of claim 2." This is a typographical error. For purposes of 
this first action on the merits, examiner assumed the following, The method of claim 18. 

Claim 24 states "The method of claim 24." This is a typographical error. For purposes 
of this first action on the merits, examiner assumed the following, The method of claim 23. 

Claim 32 states "The method of claim 15 " This is a typographical error. For purposes 
of this first action on the merits, examiner assumed the following, The method of claim 3 1 . 

Claim Rejections - 35 USC §102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 2 1 (2) of such treaty in the English language. 

3. Claims 1-43 are rejected under 35 U.S.C. 102(e) as being anticipated by Pub No US 
2001/0000962 issued to Rajan (hereafter Rajan '962). 

Regarding claims 1, 17 and 33, Rajan '962 discloses: 
(a) at least one multimedia information input interface receiving said multimedia information 
[Fig 1 and paragraph 0040] 
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(b) a computer processor [Fig 1], coupled to said at least one multimedia information input 
interface receiving said multimedia information therefrom, 

processing said multimedia information by performing object extraction processing to generate 
multimedia object descriptions from said multimedia information [scene description information, 
paragraph 0042] 

processing said generated multimedia object descriptions by object hierarchy processing to 
generate multimedia object hierarchy descriptions indicative of an organization of said object 
descriptions [paragraph 0043] 

wherein at least one description record including said multimedia object descriptions and said 
multimedia object hierarchy descriptions is generated for content embedded within said 
multimedia information [paragraph 0044] 

( c ) a data storage system, operatively coupled to aid processor for storing at least said at least 
one description record [Fig 1, 105, 176, 186, 160, 170] 

Regarding claims 2, 18 and 34, Rajan '962 discloses image object description [paragraph 

0043] 

Regarding claims 3, 7, 19 and 23, Rajan '962 discloses image segmentation [composition 
layer, paragraph 0045] and feature extraction [pitch of a sound, paragraph 0045] 

Regarding claims 4, 20, 35 and 39, Rajan '962 discloses size [scale, paragraph 0044] 
Regarding claims 5, 21 and 36, Rajan discloses spatial characteristics [paragraph 0044] 
Regarding claims 6, 22, 37, 41 and 43, Rajan '962 discloses logical descriptions 
[paragraph 0043] 
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Regarding claims 8 and 24, Rajan '962 discloses encoding the image object hierarchy 
descriptions [paragraph 0042] 

Regarding claims 9, 25 and 38, Rajan '962 discloses video object hierarchy descriptions 
[paragraph 0040] 

Regarding claims 10 and 26, Rajan '962 discloses temporal video segmentation 
[paragraph 0044] region segmentation [positioning parameters, paragraph 0043], feature 
extraction [paragraph 0045] 

Regarding claims 1 1 and 27, Rajan '962 discloses an event feature description of time 
[paragraph 0044] and an object feature description of shape size position motion and time 
[paragraphs 0042-0045] 

Regarding claims 12, 28, 40 and 42, Rajan '962 discloses physical event hierarchy 
descriptions [paragraph 0044] and temporal descriptions [paragraph 0044] 

Regarding claims 13, 14, 29 and 30, Rajan '962 discloses logical event hierarchy 
organization [paragraph 00043], video objects [paragraph 0040] and temporal descriptions 
[paragraph 0040] 

Regarding claims 15 and 31, Rajan '962 discloses temporal video segmentation 
[paragraph 0041] grouping of video events into regions [paragraph 0043] and feature extraction 
[paragraph 0045] 

Regarding claims 16 and 32, Rajan '962 discloses encoded description information 
[paragraph 0042] 
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Conclusion 



4. 



The prior art made of record and not relied upon is considered pertinent to applicant's 



disclosure: 

1. US Pat No 5,630,121 issued to Braden-Harder et al discloses structured indexes for archiving 
and retrieving of multimedia information. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Etienne LeRoux whose telephone number is (703) 305-0620. 
The examiner can normally be reached on Monday - Friday from 8:00 AM to 4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Safet Metjahic, can be reached on (703) 308-1436. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-3900. 
Etienne LeRoux , 



August 8, 2003 
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